Papers by Adrià De Gispert
Accelerating NMT Batched Beam Decoding with LMBR Posteriors for Deployment (N18-3)
Copied to clipboard
| Challenge: | LMBR techniques for NMT still yield better results than Transformers . but with NMT, real time decoding is challenging without GPUs and high-end GPUs are expensive. |
| Approach: | They propose a batched beam decoding algorithm for NMT with LMBR n-gram posteriors and an acceleration strategy for deployment to take advantage of the higher adequacy. |
| Outcome: | The proposed method outperforms the most recent results with Transformers in terms of speed and memory usage. |